AWS CodeBuild CI Report

• CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
• Commit ID: 20b2d01
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

• CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
• Commit ID: 20b2d01
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Hey @ericfzhu thanks for opening this. It is true that from pyarrow v21+ it stopped building on AL2 due to an older CMake, but you should still be able to use an older version pyarrow (technically >=8,<23) on AL2 if you can't upgrade AL2023.

The notice makes me think we require pyarrow 21+ which isn't exactly true, perhaps it needs to be slightly updated.

Would pinning or installing a lower version of PyArrow be a better recommendation here? Basically something like:

awswrangler>=3.14.0 defaults to PyArrow 21.0.0+, which requires CMake 3.25+ to build. On AL2-V3 notebook instances (CMake 2.8), you have two options:

• Upgrade to AL2023-v1
• Pin PyArrow to an older version:
  !pip install awswrangler "pyarrow<21"

@ericfzhu Something along the lines of:

1. AL2 - Pin to lower pyarrow
2. AL2 - Upgrade CMake
3. Upgrade to AL2023